Statistical Mechanics of Temporal Association in Neural Networks
نویسندگان
چکیده
We study the representation of static patterns and temporal associations in neural networks with a broad distribution of signal delays. For a certain class of such systems, a simple intuitive understanding of the spatia-temporal computation becomes possible with the help of a novel Lyapunov functional. It allows a quantitative study of the asymptotic network behavior through a statistical mechanical analysis. We present analytic calculations of both retrieval quality and storage capacity and compare them with simulation results.
منابع مشابه
معرفی شبکه های عصبی پیمانه ای عمیق با ساختار فضایی-زمانی دوگانه جهت بهبود بازشناسی گفتار پیوسته فارسی
In this article, growable deep modular neural networks for continuous speech recognition are introduced. These networks can be grown to implement the spatio-temporal information of the frame sequences at their input layer as well as their labels at the output layer at the same time. The trained neural network with such double spatio-temporal association structure can learn the phonetic sequence...
متن کاملStatistical mechanics of temporal association in neural networks with transmission delays.
We study the representation of static patterns and temporal sequences in neural networks with signal delays and a stochastic parallel dynamics. For a wide class of delay distributions, the asymptotic network behavior can be described by a generalized Gibbs distribution, generated by a novel Lyapunov functional for the deterministic dynamics. We extend techniques of equilibrium statistical mecha...
متن کاملHand Gesture Recognition from RGB-D Data using 2D and 3D Convolutional Neural Networks: a comparative study
Despite considerable enhances in recognizing hand gestures from still images, there are still many challenges in the classification of hand gestures in videos. The latter comes with more challenges, including higher computational complexity and arduous task of representing temporal features. Hand movement dynamics, represented by temporal features, have to be extracted by analyzing the total fr...
متن کاملThe Application of Multi-Layer Artificial Neural Networks in Speckle Reduction (Methodology)
Optical Coherence Tomography (OCT) uses the spatial and temporal coherence properties of optical waves backscattered from a tissue sample to form an image. An inherent characteristic of coherent imaging is the presence of speckle noise. In this study we use a new ensemble framework which is a combination of several Multi-Layer Perceptron (MLP) neural networks to denoise OCT images. The noise is...
متن کاملAnalysis and Modeling of Yield, CO2 Emissions, and Energy for Basil Production in Iran using Artificial Neural Networks
The present study attempts to investigate the potential relationship between input energies, performance production of greenhouse basil, and greenhouse gases emitted from this product. The data were collected from 24 greenhouses using a questionnaire and verbal interaction with farmers. Results of the study showed that the total input energy and total output energy for basil production were 119...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1990